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ABSTRACT 


Inventory systems may be analyzed using techniques which 
were originally devised to study the dynamic response of servo- 
mechanisms, This paper uses these methods to study an inventory 
system using exponential smoothing to predict a demand which is 
assumed to have a linear trend with uncorrelated noise components, 
The statistical properties of the estimator are investigated, and 
both exact and limiting expressions for its mean and variance are 
derived, The model is assumed to have a fixed time lag between 
the placing of a replenishment order and its receipt, and the 
system response is determined for impulse, step and ramp inputs, 
The choice of a smoothing constant is discussed, and the effect 
of the choice on the variance of the forecast equation, and the 


response time of the system is analyzed. 
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1, Introduction, 

This paper is a study of a dynamic inventory system using 
techniques of linear systems analysis(1). The model is an inventory 
control system with a fixed order point, and a known fixed time lag 
between the placing of a replenishment order and its receipt, The 
demand is assumed to be random, with a linear trend and uncorrelated 
noise components, Exponential smoothing is used to forecast future 
demand (2). The reorder rule is designed to minimize inventory 
variation for any sequence of forecasting errors (4). The controlled 
quantity (inventory) may be either positive or negative, A negative 
inventory represents a situation where the demand has exceeded the 
material on hand, and back orders have been placed against future 
deliveries. In order to facilitate the mathematical manipulations, 
the system equations will be transformed using generating functions, 
and the response of the system to deterministic inputs (impulse, 
step, and ramp) will be investigated, In this paper the term 


estimate is synonymous with predict. 


2. Generating Functions 

In order to facilitate analysis of the system, the variables 
shall be treated as infinite discrete time series, and their gener- 
ating functions will be obtained, For example if X is the input 
(demand), with components X(n); n=1,2,..., then the generating 


function for X is given by, 
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An important characteristic of generating functions is the 
following: 
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where g, £ and h are arbitrary discrete time series with components 


g(n), f£(n) and h(n) then 


0° oO 
fy) mM 
wn 2 EME" = > FZ f ce) h(m-) 
M=60 Nz ap 


: 2 foez™ > hipz? 
=o $= 0 


g'cz) = fit) hea) 


or 


Thus, the convolution operation on the original variables is 


analagous to multiplication of the transformed variables. 


3, Flow Graphs 

Flow graphs are compact "visual devices" that help describe 
relationships in a linear system where the basic operation performed 
is convolution, For example equation (2-3) may be represented 


graphically as: 
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where the input to the system is some descrete time series f, and 
the output is another discrete time series g which is produced by 
the convolution of f£ with the system "transfer function" h. The 
circles at the input and the output of the system are called "nodes" 
and any path connecting two nodes is called a "branch", The purpose 
of introducing this notation is that more complex systems may be 
simplified into equivalent systems such as pictured above by 


applying some general equivalence rules. For example 





is equivalent to 


because of linearity. 


A network which is similar to the inventory problem is: 





where i is the input to the network and o is the output. The 
letters above the branches represent the transfer function of their 
respective branches, 

This is similar to networks found in electrical control systems 
and methods devised for analysis of these physical systems work 
equally well in the analysis of the inventory system, A first step 
in the analysis is to find any "loops" in the systems, i.e., a closed 
path through the network in the direction of the arrows which touches 
no node more than once in one traversal of the "loop". In the above 
example cde is a loop. The "loop product" is defined as the negative 
product of the transfer functions of the branches making up the 
loop. In the above example -cde is the "loop product", The network 
determinant (A) is defined as 1 plus the sum of all the loop 
products in the network, In this case: 

A=l-cde 

The final quantities required are the path transmission P, and 
the path determinant A; . P,; is simply the product of the branch 
transfer functions for any simple path between the input node and 
the output node in the direction of the branch arrows, In the 
example above there are two path transmissions P, = a d 


1 


P. =bed 


The path determinant is 1 plus the product of all loops in the net- 


work which do not share any node in the path, In the above example 
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The network transfer function is then defined as 


(3-1) t= eae 
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In the above example 
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This result will be used in the analysis of the inventory problem. 


4, Exponential Smoothing 

The operation of exponential smoothing is a weighted average 
of past observations used to predict what some future value of the 
variable will be, The weight given to previous observations 
decreases geometrically with age. The forecast equation used in 
this paper is a linear combination of single and double exponential 
smoothing, It will be shown that a linear combination of single 
and double smoothing yields an asymtotically unbiased estimate of 
the demand when the demand is assumed to have a linear trend, 


The Single Exponential Smoothing operator is given 


by: 
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Where X, is the initial estimate of the demand and B= l— of 


Suppose demand has no trend component, i.e.: 


X(t)= ae €, t>o 


Where a is a constant and C. is random with 
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lé the initial estimate of the demand is an unbiased estimate 


based upon past observations then 
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Since smoothing is a linear operation: 
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Where oO," ig the variance of the initial estimate of demand. 
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Hence, 
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It follows that: 
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The above results indicate that exponential smoothing gives an 
asyntotically unbiased estimate of the demand and, if the criterion 

for choosing the smoothing constant were minimum variance, the choice 

< = Q would be optimal. This of course would be the same as using the 
initial estimate of demand for all future estimates and would negate 
the most desirable trait of exponential smoothing, i.e.: adjusting 

the estimate when the time demand changes, [t does however indicate 
that where there is a high degree of confidence in the initial estimate, 
and it appears that changes in demand are unlikely, a small value 


of the smoothing constant is preferable. 


5. Double Exponential Smoothing 

For inventory situations where the demand is assumed to have 
the form: 

X(t) =@+e as discussed above, the single smoothing 
operator gives a suitable estimate of future demand, If demand is 
assumed to have a linear trend component, then it will be shown 
that both single and double smoothing give biased estimates of the 
demand even in the limit, but a linear combination of the two 
operaters yields an asymtotically unbiased estimate, 
For the linear model: 

X(t) = a+ bt+€ where a and b are constants and, 

Ele J =o 

ELe}so* VE with 


E Le.e,]s 0 WA s. 4 





Let f, = a + bt so that, 
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The above result shows that the single smoothing operator does 
not give an unbiased estimate of the demand in the linear model 
even asymtotically. Moreover, after a sufficient time period to 
allow the exponential terms to become negligible the expected value 


of the single smoothing estimator may be written as; 
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Similarly for double smoothing: 
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Here again the estimate is biased and the limiting mean may be 


written approximately as: 
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Using these approximations it can be seen that: 
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are asymtotically unbiased estimates of the parameters in the linear U 
model, Although the estimates are not unbiased the bias does 
decrease exponentially with time, Using these estimators, the fore- 


cast of demand at time (t +?) becomes: 
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The generating functions for exponential smoothing will now 
be introduced, As given in equation (4-1), single smoothing may 


be written as: 
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which is the convolution of the single smoothing operator with the 
discrete time series of demand. In the limiting case, i.e., 
where the initial demand time becomes negligible (or setting xX, = 0), 


the transformed equation may be written as: 
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where s’ (@) is the transform of an exponential decay function, L.e.:; 
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It now remains to find the variance of the forecast equation. 
First the variance of the second order smoothing operator will be 
found, 


For the linear model: 
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The summation in the first term of equation (5-14) may be evaluated 


is the variance for second order smoothing, 


directly or it can be recognized that this is the sum of the first 
t squared terms of the impulse response of the second order smoothing 


operator, 1.e.; 
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where S Oh) is the Z transform for the second order smoothing 


operator, If we denote the impulse response by F(z); 
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where x' (2) = 1 (the Z transform of a unit impulse at t 2 QO). 
The impulse response is: 
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The transfer function approach may also be used to evaluate the 


variance of the forecast equation, In this case 
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The impulse response is; 
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and the sum of the squares of the response terms is 
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The limiting or asymtotic variance of the estimator then becomes 
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It is then apparent that the proper linear combination of single 
and double exponential smoothing will give an asymtotically un- 
biased estimate of demand where there is a linear trend, and the 
noise components are uncorrelated. As can be seen in the derivation 
of the moments of the smoothing operator the variance of the operator 
is a weighted sum of the variance of the observed demand and the 
variance of the initial estimate, As more observations are obtained 
the variance then approaches the limiting variance as given by 
equation (5-17) for the forecast equation of the linear model. In 
the limiting case it can be seen that small values of & give the 
smallest variance, It will be seen later in the paper that 
although small variance is a desirable characteristic of any fore 
cast, the response of the forecast equation to changes in demand 
pattern is also a function of ~ and if & is chosen to be small the 


model will be slow in responding to changes in the demand. 
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6, Fixed Lag Inventory Model: 

The problem to be considered is an inventory system where there 
are fixed order points, In practice this would correspond to an 
activity which finds it more economical or necessary to adhere 
to a regular order schedule, and can only place replenishment 
orders at the beginning of each input period. Specific character- 
istics of the system are: 

1) The item has high usage, and there are indications of a linear 
trend in the demand, 

2) There is no seasonal variation in demand, and no correlation 
in the error terms, 

3) The order points are fixed and equally spaced, 

4) When demand exceeds the inventory on hand, back orders are 
placed against future deliveries, 

5) There is a fixed time lag between placing a replenishment order 
and receipt of the order. Time lag is measured in demand periods, 
6) Time is measured from the end of the demand period, 


7) A replenishment order placed at time t, may be used to fill demand 


k 
generated during demand period (t, + T + 1), where the time lag is T, 
8) Oversupply may be returned to the vendor; i.e., a negative order 
quantity may be generated. 

9) The forecast equation introduced in section (5) will be used 


to predict future demand, 


10) The forecast at time k will predict demand during period k+ T+ 1. 
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The following equations describe the model; 
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The flow graph for this model is: 
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which is a linear combination of the transforms for single and 
double exponential smoothing. The network determinant is; 
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The purpose of describing the inventory model in terms of 
flow graphs and generating functions is to determine the dynamic 
response of the system to possible demand patterns, It was seen 
that in examining the moments of the forecast equation the variance 
of the forecast equation was a function of the smoothing constant 
and the lead time fT, On examining the dynamic response of the 


system to deterministic inputs it will be seen that the same para- 
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meters determine the response time (time until all back orders are 
filled), The model will be tested with three deterministic inputs 
(impulse, step, ramp) and the model will be checked for response to 
these inputs, as well as the steady state error. 

In order to facilitate the determination of steady state error 


the following theorem from (3) is introduced. 


Let F Be the transform of f and suppose 
F(Z) converges as Z - 1 where Z is real and 
1Z1<¢ 1 and f(n) = 0 for n¢0,. Then: 
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6.1 Impulse Response 


The impulse response for the inventory model in transform 


notation becomes 
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Here 1(°) denotes the "steady state" inventory. 
In order to obtain the inverse transform, the transfer 


function may be expanded into a sum of partial fractions: 
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Then solving for the inverse; 
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In addition to the fact that there is no steady state error, 
the expression for the impulse response also shows that if the system 
was receiving a constant demand for a long period of time and there 
was a one time increase in that demand the system would respond 
in the minimum amount of time since; 
Tet) = -t 3 & 2 TH+ 
I( T+) = &(2+ AT) 
In other words, there would be a back order for a period equal 
to the delivery time but all demand would be met by time T # l, 


and then in fact there would be an excess of material (<(24+4T)) 


6.2 Response To A Step Input ( X (2) = as ) 

Testing the system with a step input gives an indication 
of system performance when there is a sudden increase in demand 
and demand continues at this new higher level, The results which 
are derived in this example apply equally to the case where there 


is a sudden drop in the demand level, 
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Using the same partial fraction expansion as above the inverse 


transform yields: 
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As expected there is again negative inventory after the 

initial change in demand, At the start; 
Ic)= - (t +1) ‘10-4 Caw 

The first order is received at (T + 1) in the amount 2 #4 (14a T). 
It appears then that if the criterion for selecting a smoothing 
constant was minimum response time, 4 = 1 would be the optimal 
choice, This would be the extreme case where no weight was given 
to past demand and the forecast was based upon only the last recorded 
demand, This of course would be impractical since actual demand 
will normally have a noise component (i.e. be probabalistic rather 
than deterministic) and as shown previously a choice of K = 1 


would make the variance of the forecast equation maximum, 
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It is then evident that no single value of the smoothing constant 
will satisfy both the requirement of minimum forecast variance and 


minimum response time, 


6.3 Response To A Ramp 

This is the type input for which the forecast equation 
was designed. The reasons for looking at the step and impulse 
responses were to see how the system performed under other than 
designed conditions. Since the system is linear and time in- 
variant the performance of the system to any combination of 
inputs may be analyzed by looking at each input separately and 
obtaining the actual response by adding the system response to each 


of the components of the input. 
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It is difficult to analyze response time from the above 
expression but if a ramp input is looked upon as a sequence of 
impulse inputs where the magnitude of the impulse at time t is 
(t + 1) the superposition property of a linear time invariant 
system leads to the conclusion that the larger the value of & , 


the smaller the response time. 


6.4 Order Rule 
As shown by Vassian (3), the order rule utilized in the 
present model gives minimum inventory variation for any sequence 


of forecasting errors, 


7. Distributed Lag Inventory Model 

The preceding model with a fixed lag time was characterized 
by a system response which was a function of the smoothing constant 
and an inventory which tended to overshoot the demand when < was 
chosen to be large in order to decrease the response time. The 
same problem will now be examined when the lag time is distributed 
rather than fixed (5). In the context of the inventory model we 


now have that; 
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t 
where; f(t;p) = P 4 
is the probability that an order is received exactly t days after 


it is placed. 
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The order rule will now be; 
rat 
(7-2) Ot) = S007) - [ct) 


and the forecast equation will predict the demand at T = 4/p 


(the expected delivery time). 


The flow graph is: 


L tz) 





and 
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This network has the transfer function: 


y [i- 2) Le yz - (B°+2B4- é B's) ] 


(7-3) S$ = 4 ['- @z]7[2°- atte A ret) 


Pee 4 
2 A, A A 
(2%) (2-Tay " Cae * Tee 


where TY) and ry are the roots of the second degree polynominal in 


the denominator of S, and; 


A 4 | cel LE (% + A) | 
i - tg + om me /p 


“el Vie - 4 - J 


A, * Uie'- Whe + HE] 
A. [ae] [ee - 44 
3 Se - Ya} Be. 
E 25 ’ fF 4| 


, where I = [5q- bp e7 





7.1 Impulse Response 


he Sn 
ey = S 
(7-4) Lityeron B° A, cA commit hi 
= ich + eile Se Ae 
T (2) = oO 


Just as with the fixed time lag model there is no steady state 
error, but the transient response does exhibit a property not 
evident in the fixed lag model, For 0 £44 4.2 R is real and all 
of the terms in ](t) are exponential decay. For .2< % <€1.0 Ris 
imaginary and the coefficients A, and Ay, are related by: 

A,: A, 


and uf . 2, 


—>2 


xe 


so that when written in exponential form: 


nha A,= Ce 
-4f 


g = ad l, = ID) = 


and the last two terms in I(t) become 


-t1") ,Lo+(tri)f sone ad 
IReS 6 Ceo GID [e? ¥ + & | 


- (t+!) 


-CD cow lO + (+19) 


— e ® e 68 
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The response then is the sum of terms containing exponential 
decay and damped oscillation, 

The results for a step and ramp input as seen below, also 
contain terms which are damped oscilletions for the values of q 
given above, This result is not unexpected. Damped oscillation 
is present in physical systems in which there is delay in response, 
The lag in receipt in the inventory system is analagous to inertia 
in a mechanical system or inductance in an electrical system, and 
both of these physical systems will have transient responses 
containing damped oscillation under certain conditions which are 
analagous to the relationship of q in the inventory system, 

The steady state error for both the step and ramp input is 
zero in the distributed lag system and, other than this tendency 


to oscillate, the results are similar to those in the fixed lag model. 


7.2 Inventory Function For A Step Input (Distributed lag); 


when demand is a step the response is; 


(7-5) Itt) = + ie p"'] + fu,  \- Gigi tone] BY 





As [ i- Pak + Ay ie 


] 
I-7, Sis 


a ory) 


a 





7.3. Inventory Function For A Ramp Input (Distributed lag); 


when demand is a ramp the response is; 
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7.4 Summary 

The distributed lag model is probably a more realistic 
description of a practical inventory problem in that the delivery 
time for replenishment orders would seldom be a fixed constant 
as was assumed in the first model, Practical inventory problems 
are characterized by the damped oscillations of the distributed 
lag model, When the delivery time is not fixed, it should be 
expected that there will be periods of shortage and inventory 
excess caused by variations in delivery time, As can be seen in 
the above equations response time is now a function of the smoothing 
constant ~ and Pp, the parameter of the geometric distribution of 
delivery time, The inventory equations could be analyzed directly 
in order to choose an acceptable value for the smoothing constant, 
but as long as it is recognized that there will be some oscillation 
no matter how the smoothing constant is chosen it does not appear 
to be invalid to use the fixed lag formulation of the problem, where 
the fixed lag is chosen to be the expected value of the random 


variable (lag time). 
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8, Selection Of a Smoothing Constant 

In choosing a smoothing constant for the model it must be 
recognized that no single value of% is optimal for all demand 
patterns. The impulse response for the fixed lag model shows the 
relationship which exists between and the time lag. It will be 
recalled that for this model: 


Ta) =-! OCe < Tt 


[(t+1) = (2+ &T) 


This indicates that when there is noise present in the demand a 
long time lag will tend to amplify the fluctuations in inventory 
caused by the noise. This can be offset somewhat by choosing a 
smaller when T is increased, but when & is reduced the response 
time is increased, The effects of decreasing € however would be 
felt in the sensitivity of the forecast to changes in parameter, 
If the slope of the trend component were to increase, a smaller 
value of “ would cause the forecast to lag behind the demand for 
a longer period of time, Any final choice of * would also have 
to take into consideration the "cost" of stock outages vs the 
holding cost of excess inventory. The model considered controlled 
the inventory about the zero level and in most practical cases a 
non zero safety level of stock would be maintained. Any non zero 
safety level would alleviate the response time problem since this 
buffer stock would compensate for forecast errors during a period 


of change in demand pattern. All of these factors seem to favor 
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a small smoothing constant to increase system stability, and a 


safety stock level to compensate for the increased response time, 


9, Conclusions 

The use of flow graphs and generating functions provide a 
simple method of obtaining some insight into the characteristics 
of an actual inventory system, Testing the model with deterministic 
inputs allows the inventory manager to check his reorder rule for 
stability and to decide if his forecast equation is satisfactory 
as regards response to fluctuations in demand patterns, The primary 
advantage of using exponential smoothing to predict demand is its 
flexibility and its economy of computer storage space where it is 
used in a mechanized activity, The flexibility allows the inventory 
manager to make trade offs between response time and forecast var- 
iance by simply adjusting the smoothing constant, If the demand 
pattern changes at any time, he may increase or decrease A , and 
if this a temporary change in pattern he may at any time return to 
the former value of & , The economy of storage space is apparent 
when exponential smoothing is compared to the use of a moving 
average to predict demand, Where the moving average estimator 
using the last N observations of demand would require N storage 
locations for each item of inventory, exponential smoothing requires 
only one location to retain the last smoothed value, In this 
regard, if a moving average estimator provides satisfactory pre- 


dictions for a given inventory situation, an exponential smoothing 
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estimator can easily be constructed which will have the same 
limiting variance as the moving average estimator, 
For example if a moving average has been used to predict demand 


for a constant model; i.e.: 


X(t) = Qt é. 


where the noise is uncorrelated with variance o", The moving average 


estimator is 


t 


Ve ee 
(8-1) X, Ni re 


1) 


{= C-N+1 


and 
y I 


(8-2) Van x, | = cee 
N 


as shown in section (4) the limiting variance for single smoothing 


in the case of the constant model was: 





Var [Sco | = 1+ B E 


so that if & is chosen so that 

(8-3) a = 4/N4+1 
the limiting variances of the two estimators are identical. A 
similar criterion could be established for the linear model and « 
could be chosen to make the variance of the estimate approximately 


the same as that for an acceptable moving average operator. 
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